Papers by Hossein A. Rahmani
A Survey on Asking Clarification Questions Datasets in Conversational Systems (2023.acl-long)
Copied to clipboard
| Challenge: | Existing studies on Asking Clarification Questions (ACQs) are incomparable due to inconsistent data, experimental setups and evaluation strategies. |
| Approach: | They analyse the current research status on Asking Clarification Questions (ACQs) and propose a set of evaluation metrics and benchmarks for multiple ACQs-related tasks. |
| Outcome: | The proposed techniques are compared with the available datasets and evaluated against benchmarks. |
Clarifying the Path to User Satisfaction: An Investigation into Clarification Usefulness (2024.findings-eacl)
Copied to clipboard
| Challenge: | Poorly formulated questions can lead to user frustration and dissatisfaction . |
| Approach: | They propose to leverage key features that contribute to the classification of clarifying questions, enhancing user satisfaction and system performance. |
| Outcome: | The proposed model improves with a minimum performance boost of 45% in traditional classifiers, especially in large language models. |
Transparent and Scrutable Recommendations Using Natural Language User Profiles (2024.acl-long)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) rely on implicit or explicit feedback from users to suggest new items, resulting in a lack of transparency and a user's ability to scrutinize and modify their preferences. |
| Approach: | They propose to use a natural language (NL) user profile to summarize a user's preferences and then use it to fine-tune a LLM using only NL profiles to make transparent and scrutable recommendations. |
| Outcome: | The proposed model performs on two benchmarking rating prediction datasets and is comparable to existing models. |
AgentCoMa: A Compositional Benchmark Mixing Commonsense and Mathematical Reasoning in Real-World Scenarios (2026.acl-long)
Copied to clipboard
| Challenge: | brittleness of Large Language Models in reasoningintensive tasks is a problem . current compositional benchmarks focus on *either* commonsense or math reasoning . |
| Approach: | They propose a "Co**mmonsense and Ma**th" benchmark where each compositional task requires a commonsense reasoning step *and* a math reasoning step. |
| Outcome: | The proposed benchmarks show that LLMs can solve both steps in isolation, but their accuracy drops by nearly 30% when the two steps are combined. |